Ensemble Renormalization Group for Disordered Systems 



O 

> 
O 



I 

CZ3 



I 

o 
o 



> 

00 



Maria Chiara Angelini, Giorgio Parisi, and Federico Ricci-Tersenghi 

^ Dipartimento di Fisica, Universita "La Sapienza", P.le A. Mom 2, 1-00185 Roma, Italy 
^ Dipartimento di Fisica, INFN - Sezione di Romal, CNR - IPCF UOS Roma, 
Universita "La Sapienza", P.le A. Mora 2, 1-00185 Roma, Italy 

We study a Renormalization Group transformation that can be used also for models with quenched disorder, 
like spin glasses. The method is based on a mapping between disorder distributions, chosen such as to keep some 
physical properties (e.g. the ratio of correlations) invariant under the transformation. We validate this Ensemble 
Renormalization Group by applying it to the hierarchical model (both the diluted ferromagnetic version and the 
spin glass version), finding results in agreement with Monte Carlo simulations. 



The renormalization group (RG) is a fundamental tool in 
theoretical physics It allows to characterize phase transi- 
tions and critical phenomena, by computing critical exponents 
and universality classes. The real space RG can be viewed 
as a decimation procedure that takes a system made of N 
dynamical variables and reduces it to a smaller system, in a 
way which preserves, or scales appropriately, some important 
physical observables. Such a decimation induces a RG trans- 
formation on the system couplings, and the study of such a 
transformation allows one to identify critical points and criti- 
cal exponents. 

Real space RG transformations have been studied in great 
detail for homogeneous models but much less is known 
for disordered models, that contain quenched randomness in 
the Hamiltonian (either random fields and/or random cou- 
plings). This is specially true for frustrated models, like spin 
glasses (SG), for which a satisfying RG transformation is still 
lacking. For example, for the Edwards-Anderson SG model 
(12] on a D-dimensional lattice all the attempts to develop a 
field theory by performing an e-expansion around the upper 
critical dimension = 6 have proved to be very compli- 
cated [3, 4}]. These studies have led to the discovery of fixed 
points different from the mean-field (MF) ones, however the 
implications of that are not completely clear. In particular the 
existence of replica symmetry breaking (RSB) fixed points in 
the non-mean field region D < has been shown only very 
recently |5] and estimates of critical exponents in Z? = 3 are 
still not reliable. 

In this framework the development of a (semi-)analytical 
real space RG for disordered models would be very welcome. 
The outcome of such a RG transformation could be well com- 
pared with Monte Carlo (MC) simulations, that provide accu- 
rate estimates of critical temperatures and critical exponents 
for disordered models. Previous attempts of developing such 
a real space RG for disordered systems [6] focused on trans- 
formations mapping a single sample of size iV to a smaller 
system (without loss of generality we can set the size of the 
smaller system to N/2). In formulae, we can write the map- 
ping {Jij} {Jij} the one solving a set of equations like 



{Ok{{J^M = muiM 



(1) 



the smaller system and the number of observables Ok are 
enough to determine the new couplings {Jij}. Given an en- 
semble of systems of size N, the above transformation can be 
applied to each of them in order to obtain an ensemble of sys- 
tems of size N/2. However we believe that such a mapping 
is suboptimal for models with quenched disorder and a bet- 
ter RG transformation should consider explicitly the average 
over the quenched disorder (as was done in Ref. [7]). What 
we are proposing is a mapping between probability distribu- 
tions of couplings P{Jij) P'{J[j) such that the following 
equations hold 



(2) 



The overbar represents the average over the quenched disorder 
(i.e. the couplings in the present case). The rationale beyond 
this choice is that in models with strong disorder (like SG) 
sample-to-sample fluctuations may dominate thermal ones. 

Two simple examples may help elucidating the limits of the 
RG transformation working sample by sample, Eq.([T]), and 
thus justify the use of the one in Eq.©, that we will call En- 
semble RG (ERG). In a diluted ferromagnet, where couplings 
are positive with probability p and null with probability 1 — p, 
a single step of the decimation procedure induced by Eq.([T]| 
typically generates all non-zero couplings (i.e. p = 1). And 
this is clearly not very useful if one is willing to follow the 
RG flow in the p — T plane. Moreover, in frustrated models 
the decimated system is typically much less frustrated than 
the original one: the extreme case is the transformation of a 4- 
spins system in a 2-spins system, being the latter unfrustrated 
for any coupling choice! This tendency to reduce frustration 
makes the RG using Eq.© clearly unfit to describe SG fixed 
points. 

In principle, our ERG scheme can be applied to any dis- 
ordered system. We choose here to apply it to the hierarchi- 
cal model (HM), which is a particular one-dimensional long 
range model, whose Hamiltonian for N = 2" spins can be 
constructed iteratively in the following way [St] : 

Hn{si, S2") = Hn~lisi, S2..-i) + 



where angular brackets are thermal averages with respect to 
the Gibbs-Boltzmann distribution, primed quantities refer to 
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In practice ff„ is the sum of interactions at n different levels. 
We have studied three versions of this model: the ferromagnet 
(FM), where Jij — 1; the diluted ferromagnet (DFM), where 
a random fraction 1 — p of FM couplings are set to zero; and 
the SG version [9], with Gaussian couplings P{J) oc e~'-' 1"^ . 

There are many reasons to test a new RG transformation 
on the HM. First, by properly tuning the topological factor c 
that controls how fast the couplings intensity decays with dis- 
tance, the HM can emulate a /^-dimensional short range (SR) 
model: c ~ 2-^-* for DFM and c ~ 2(-i-*)/2 for SG. 
These relations are exact around the upper critical dimensions 
because the long range HM and the SR D-dimensional model 
have the same field theory at leading order In order to have a 
phase transition at a finite temperature, the c parameter must 
satisfy i < c < i for the DFM and ^ < c < ^ for the SG. 
Lower bound values of c correspond to lower critical dimen- 
sions (and thus — 0), while if c reaches the upper bound 
the energy is no longer extensive (thus Tc — oo). For c > 2~ 2 
in DFM and c > 2^ 3 in SG, the model shows mean field crit- 
ical properties (like for D > in SR models). So, tuning a 
single parameter in the HM, we can move from the MF region 
to a non-MF one. 

The second reason to choose the HM, is that if the system 
is decimated by a standard block-spin transformation, the new 
Hamiltonian does not contain any multi-spin term (at variance 
to what happen on finite dimensional lattices |01)- So, consid- 
ering only pairwise interactions in the RG is not an approxi- 
mation for the HM. Moreover the FM version can be exactly 
solved in a time growing only polynomially with N , since the 
probability distribution of the magnetization satisfies 

where and rriR are the magnetizations of the half systems. 

We describe now in detail how to apply the ERG to the HM. 
We assume couplings to remain independent during the RG, 
but we allow couplings to have a different probability distri- 
bution at each level: in the original HM all couplings have 
the same probability law, but we have seen that the RG itera- 
tion produces different couplings at different levels. Each cou- 
pling distribution is parametrized hy K e {1,2} few numbers 
(that is the mean for FM, the variance for SG and the fraction 
of non-zero couplings and the mean for DFM), otherwise the 
search for a solution to Eq.(|2|i would become too difficult. We 
start from a system with n levels that we want to reduce to an 
"equivalent" smaller system of n — 1 levels. 

1. First we compute {n ~ 1)K observables (Ok) in the 
larger system (in the FM the overbar can be omitted). 

2. Then we identify the distributions of couplings in the 
smaller system by requiring that (Ok) = {O'f^) for any 
fce{l,2,...,(n-l)X}. 

3. Finally we join two smaller systems with random cou- 
plings extracted from the original distribution, to obtain 
again a system of the original size. 

The first two steps are the true renormalization steps, while the 
latter is required to obtain a final system size, that will allow 
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FIG. 1 : (color online) RenormaUzed couplings J' in a FM 
system with n = 10 levels versus the number of RG steps, for 
temperatures slightly bigger (left) and smaller (right) than Te- 
ns to iterate the method, until convergence. Thermal averages 
are computed exactly: this is easy to do in the FM, while in 
the DFM and in the SG we do it by exhaustive enumeration, 
thus limiting us to a small number of levels in the disordered 
cases. The average over the disorder is not exact, but taken 
over ^ 10^ samples. Step 2 is actually accomplished by min- 
imizing J2ki(^k) ^ (OJ.))^, and we have checked that the 
reached minimum is always very close to zero. Since cou- 
plings distributions are different at each level, we do not see 
any better option than extracting the new couplings in step 3 
from the original distribution. 

The FM version of the HM, that has been solved analyti- 
cally, is a benchmark for our numerical implementation of the 
ERG. For c = 2~3, that corresponds to £> = 3, the critical 
temperature is Tc = 0.848154717 [10], and the critical ex- 
ponents are 77 = Q, 7 = 1.299140730159(1) UM, leading to 
ly = 0.649570365 using the scaling relations (while for a 3D 
Ising FM they are v = 0.6301(4), rj = 0.0364(5) fH]). 

The observables Ok that we use in the RG equations are the 
correlation of the magnetization at level k + 1, normalized by 
those at level k, with fc G {1, . . . , n — 1}: 

[Ok) = 7 r ■ 

The denominator is necessary to reduce finite size effects and 
to ensure that a solution to the RG equations exists (this is not 
true in general for other observables, like the magnetization). 

Applying the previously described procedure, the flux of 
couplings and correlations can be followed, see Fig. [T] If 
T ~ Tc, renormalized couplings stay for a while close to the 
critical fixed point (FP), and then go towards the high temper- 
ature (HT) FP if T > Tc or the low temperature (LT) FP if 
T < Tc- We estimate the critical temperature as the temper- 
ature dividing the flows towards the two different FP. Please 
note that the HT and LT fixed points are not characterized by 
the usual J = and J = 00 coupling values: the reason is that 
in step 3 of our procedure we put new coupling of original in- 
tensity. Nonetheless couplings flows clearly differentiate HT 
and LT behaviors. 

In order to extract critical exponents from the RG equations, 
we focus on the early regime, when the coupling flows leave 
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FIG. 2: Difference between the renormalized couplings at 

Ti = 0.84571 and Ta = 0.845716 in the FM HM with 
n — 13 levels and D = 3. The fit estimates the exponent. 



the critical FP. From the Wilson relation an equation relating 
renormalized coupling after x RG steps can be obtained: 



Jljx) _ J2{x) 



where b = 2"° is the scaling factor in our case. Thus, the v 
exponent can be estimated from a fit like the one in Fig. |2l 
The values obtained for the critical temperature and the criti- 
cal exponents in Z) = 3 are well comparable with the known 
ones: Tc extrapolates to 0.8478(1) in the large n limit and the 
measured ly exponent is 0.692(2) for n = 13 (although the 
extrapolation of to the n — >^ cxd limit is much harder due to 
strong finite size effects). Moreover we have checked that our 
numerical RG recovers the right bounds on c, namely Tc ^ Q 
for c = 1/4 and Tc oo for c = 1/2. 

We consider now the DFM. The Hamiltonian of the model 
is always the one in Eq. ([3]), but the couplings at level k are 
independent random variables extracted from the distribution 

Pk{J) = Pk 5{J ~ Jk) + (1 - Pk) S{J) . 

At the beginning pk — p and Jk — I for any k, while under 
the RG they will differentiate. The number of parameters to be 
determined in the ERG is 2{n — 1), and we use the following 
observables, with fc G {1, . . . , n — 1}, to fix them: 



Applying the same procedure as for the pure model, we are 
able to draw a flow diagram in the p — T plane for D = 3 
and determine the critical line (see Fig. O. The validity of 
the phase diagram found with the ERG is confirmed by a set 
of MC simulations |13] whose Tc estimates are also shown 
in Fig. [3] The only disappointment about this phase diagram 
is that we do not find an unstable FP along the critical line 
as expected for a D — 3 SR model 1, 14] . However this can 
be explained by noticing that the a exponent of this model is 
very small, a = 0.051288905, and so the crossover from the 
pure behavior can be extremely long. 

Finally we study the SG version. The Hamiltonian is al- 
ways the one in Eq. (O, and the couplings at level k are dis- 
tributed with a Gaussian law of zero mean and variance al 
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FIG. 3: Phase diagram in the p ^T plane for the 3D DFM 
as obtained by the ERG and by MC simulations. Arrows 
represent the first iteration of the ERG. 




FIG. 4: (color online) Variances of renormalized couplings 
(left) and of SG correlations (right) at the lower level (k — 1) 

in a SG system with n — A levels and L* = 3 versus the 
number of renormalization steps x, for many temperatures. 
We locate the critical temperature at Tsg — 0.58(1). 



(at the beginning (t| = 1 for any k). The assumptions that 
the renormalized couplings are independent and normally dis- 
tributed can be released by adding extra terms in the coupling 
distributions [7], but we leave these generalizations for future 
works. In the SG case the observables used to fix the n — 1 
variances are SG correlations at different levels: 



E 



E 



Because of the computational costs we use n < 4, so the 
early regime leaving the critical FP is rather short, and the sta- 
tionary regime is soon reached (with respect to the FM case). 
This effect is also enhanced by the disorder: indeed, even ex- 
actly at criticality, the SG ensemble contains many samples 
which are not critical, and the couplings of these samples flow 
away from critical values very fast. So, it seems unavoidable 
that disorder increases the instability of critical FP and conse- 
quently the uncertainty on the estimates of critical exponents. 
Nonetheless we can distinguish two temperature regions sep- 
arated by a critical temperature Tsg (see Fig. |4] for an effec- 
tive dimension D — 3 and Tsg — 0.58(1)), such that above 
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FIG. 5: Difference between the renormalization flux of the 
couplings at two different temperatures in a semi-log scale 
for D = 3 < D„ (left) and £> = 8.2 > L>„ (right). The first 
part, not affected by finite size effects, has been used to 
extract the v exponent, through a power law fit. 



5.5 
5 
4.5 

4 



3.5 ^ 

3 - 




HM ERG 

,„u ^ EAMC 

2 order e-exp. d/2 

3 4 5 6 7 8 ' 

D 



10 



FIG. 6: The estimation of the v exponent from the ERG at 
different effective dimensions D. The line for > 6 is the 
MF prediction, while the one for D < 6 is just a guide for the 
eyes. Also results from the e-expansion and v values for the 
EA model in = 4, 5 are added for comparison. 



TsQ correlations and couplings decay towards zero, while be- 
low TgQ correlations and couplings variances grow, suggest- 
ing that the system is in a SG phase. In Fig. |4]we have plot- 
ted only couplings and correlations variances measured at the 
lowest level fc = 1, but (as in the FM, see Fig. [Til the renormal- 
ized variances at the other levels are related to those at fc = 1: 
for example, 02 > ui if T > Tsg and < (Ti if T < Tsg 
(remember that parameters at the lowest level are those which 
have been renormalized the largest number of times). 

Also in the SG case we are able to estimate the v exponent 
from the flux of the couplings at early times. The procedure 
used is the same of that in the FM case and typical fits are 
shown in Fig. |5]for D = 8.2 in the mean-field region and 
for £) = 3 below the upper critical dimension. We obtain 
vD = 4.15(10) in Z) = 8.2 and vD = 4.34(6) in D ^ 3. The 
mean field value is known analytically to be = 1 /2, in good 
agreement with our result. In order to check critical temper- 
atures and the critical exponent in the non-mean-field region, 
we are running MC simulations with the parallel tempering 
algorithm (to be reported in detail in a future pubhcation lll3ll ) 



and preliminary data seem to scale rather well with critical 
temperatures and exponents obtained via the ERG method. In 
Fig.|6]we report the estimates of vD for several effective di- 
mensions D: we see that in the mean-field region results are 
compatible with linear behavior D/2 and, more interestingly, 
the critical exponent vD have a minimum around the upper 
critical dimension = 6. This minimum was not observed 
in previous RG studies |6], while it is present in SR mod- 
els: in Fig.|6]we report the vD estimates for the EA model in 
D = 4,5, which are close to the ERG estimates. The same 
cusp-like behavior for the lyD exponent has been also seen in 
a ID SG model with power law decaying interactions 11511 . 



Concluding, we have developed a semi-analytical real 
space RG method that can be used for disordered systems. 
The method has been applied to the hierarchical model and is 
able to find a SG transition also for effective dimension D = 3 
in the non-mean field region. The reliability of the method has 
been tested comparing the values of critical temperatures and 
critical exponents with those obtained in MC simulations and 
the agreement is satisfactory for all the versions we have stud- 
ied: diluted ferromagnet and spin glass. 

This work also solves an apparent inconsistency problem 
between the e-expansion of the SG version |.16] and another 
real space RG approach recently proposed in Ref. i^, where 
the vD exponent was found to decrease linearly with D, with 
no minimum at all around the upper critical dimension. In this 
work we have shown that such a minimum in j^D exists if a 
better RG transformation is used. 
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